The Spherical Maximal Function on the Free 
Two-step Nilpotent Lie Group 

Veronique Fischer * 
October 24, 2008 

Abstract 

We consider here the free two step nilpotent Lie group, provided 
with the homogeneous Koranyi norm; we prove the L^-boundedness of 
the maximal function corresponding to the homogeneous unit sphere, 
for some p. 

Key words, spherical means, maximal functions, nilpotent Lie groups, 
spherical function, Plancherel formula. 

1 Introduction 

This article is organized as follows. As introduction, we collect some results 
and methods of work on singular maximal functions corresponding to av- 
erages over dilations of a fixed surface on a nilpotent Lie group. We also 
present our main result. 

Then we define precisely the free two-step nilpotent Lie groups, maximal 
L^-inequality and the square functions used here (Section 2). 

Next (Section 3), we prove L^-maximal inequalities corresponding to Ko- 
ranyi homogeneous spheres, assuming L^-boundedness of our square func- 
tions. This hypothesis is proved in Section 5, with the help of the Plancherel 
formula and spherical functions; these notions are recalled in Section 4. 
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1.1 Some maximal functions on nilpotent Lie groups 

On the Euclidean space. Stein proved iZ-maximal inequalities for Eu- 
clidean spheres; that is the supremum of the averages over the spheres cen- 
tered at a point defines an operator on the space of smooth functions, called 
"the maximal function corresponding to Euclidean spheres" (or more simply 
"the spherical maximal function"); and this operator extends to a bounded 
operator on L^(]R"). Here > n/(n — 1), n > 3 (sharp result). Bourgain 
showed the case n — 2 [1]; the case n = 1 is vacuously true. 
For the proof in [14, 16], Stein uses: 

(i) complex interpolation for the analytic continuation of the family of 
convolution operator with kernel given 

(ii) the well known I^-boundedness of the standard maximal function (cor- 
responding to the Euclidean balls) [2], 

(iii) the L^-boundedness of some square functions (with the help of the 
Euclidean Fourier transform and estimates for special functions). 

But Stein gave another proof of the same result in Corollary 3 of [15, 
XI§3], where he also presented the case of variable manifolds. The method is 
based there on oscilatory integrals operators and on curvature: in fact, the 
curvature of the unit Euclidean sphere S" is closely related to the Fourier 
transform of the probability measure of [15, XI§1]. 

On Heisenberg groups. M. Cowling offered [3] an alternative approach 
to Stein's first work on IR"; he adapted it on the Heisenberg group H" for 
the Koranyi norm: he obtained the I/'(lHI")-boundedness of the spherical 
maximal function, p > {2n + l)/2n (sharp result). 

Still on the Heisenberg group H" = C" x R, Nevo and Thangavelu con- 
sidered the case of the complex spheres {(-2,0) e C" x R : = r}, and 
showed [19, §3.6] that the corresponding maximal function is L^-bounded for 
p > (2n— l)/(2n — 2). He adapted previous works of Nevo on "ergodic" max- 
imal inequalities on some Lie groups (see [8, 11]), where the proofs are based 
(for the global part) on classical study of maximal functions for semi-groups 
[13, III§3], and on L^-estimates of square functions with spectral calculus 
(spherical functions). 

The optimal range for p is p > 2n/{2n — 1); this was proved recently by 
Narayanan and Thangavelu [10]. 
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On nilpotent Lie groups. Miiller and Seeger obtained [9] also this op- 
timal range for p in a study which concerns more general surfaces (with a 
non vanishing rotational curvature) in "non-degenerate" two-step nilpotent 
Lie groups. 

In a still unpublished work [12], the maximal functions on stratified group 
associated to hyper-surfaces with a non vanishing rotational curvature, were 
also studied by adapting Stein's second proof of the Euclidean case [15, Corol- 
lary 3 in XI§3]; it yields to their L^-boundedness with p > n/{n — 1), where 
n > 3 denotes the topological dimension of the group. In particular, it covers 
the case of the Koranyi spheres in groups of Heisenberg type, with a sharp 
range for p, and so includes the result of Cowling [3] on H". 

1.2 Our main result 

Let be the free two step nilpotent Lie group with v generators, provided 
as a stratified group, with the Koranyi norm. Let A denote the spherical 
maximal functions. We recall the definitions of these objects in Section 2. 
The main result of this paper is the i/-boundedness of A: 

Theorem 1 Assume > 4. The spherical maximal function A satisfies an 
If {N^) -inequality where 2h/{2h — 1) < p < oo and h is the largest integer 
such that h < v{v — l)/4 — 1. 

This result is new, but probably not sharp for the range of p. The group 
Ny does not fulfill the non-degeneracy condition of [9], and the surface is 
not of the type studied there neither. It is not covered by the study [12] 
because the curvature of the unit homogeneous sphere in vanishes "at the 
equator", v > 3. 

Our proof follows the first method of the Euclidean case [14], i.e. the 
points (i), (ii), (iii); but the Euclidean norm is replaced by the Koranyi norm 
and for L^-estimates of square functions (i.e. for (iii)), we use the Plancherel 
formula and the bounded spherical functions. This method for groups of 
Heisenberg type (and always Koranyi homogeneous spheres) gives a result 
included in [12] (see the French PhD thesis of the author [5]). 

The rest of this paper is organized as follows. We start by setting defini- 
tions and notations for the group, the spherical maximal function and square 
functions denoted (Section 2) . We give then the proof of our main theo- 
rem (Section 3), provided that some square functions satisfy L^-estimates. 
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Next (Section 5) we prove this hypothesis, using the Plancherel formula and 
spherical functions (notions recalled in Section 4). 

2 Definitions and Notations 

Here we set definitions and notations for the group, the spherical maximal 
function and the square functions that we study. 

In this paper, we assume v is an integer such that v >2. 

2.1 Free two-step nilpotent Lie algebras and groups 

Let J\fv be the (unique up to isomorphism) free two-step nilpotent Lie algebra 
with V generators; the definition using the universal property can be found 
in [7, Chapter V §4]. Roughly speaking, A/",, is a two-step nilpotent Lie 
algebra with v generators Xi, . . . , Xy, such that the vectors Xi, . . . ,Xy and 
Xij = [Xi, Xj], i < j, form a basis of the vector space A/^. 

We denote by V and Z, the vector spaces generated by the families of 
vectors Xi,...,Xy and Xij :— [Xi,Xj],l < i < j < v respectively; these 
families become the canonical bases of V and Z. Thus Af^ = V (B Z is a 
stratified algebra (see [6]), and Z is the center of the Lie algebra J\fy. Let 
z = v{v—l)/2 be the dimension of Z and Q = v+2z = be the homogeneous 
dimension. We write v — 2v' or 2v' + 1. 

The connected simply connected nilpotent Lie group which corresponds 
to My is called the free two-step nilpotent Lie group and is denoted N^. We 
denote by exp : the exponential map. In this paper, we use the 

notations X + A G A/", exp(X + A) e N when X eV,A e Z. For an element 
n — exp(X + A) E N , we define the dilations: r.n — exp(rX + r^A), r > 0, 

and the (homogeneous) Koranyi norm: \n\ — {\X\^ -\- 1^^)" (see [6]). 

2.2 Some measures 

The canonical bases of V and Z induce Lebesgue measures on V and Z 
respectively, thus on jV, and a Haar measure dn on Ny. In this paper, the 
LP spaces over A^^, and the measure for a Borel set E <Z Ny are related to 
the Haar measure dn. 

We denote /i the unique Radon measure on the unit homogeneous sphere 
:= {n & Ny , \n\ = 1} such that for each integrable function / on Ny, we 
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have [6, prop. 1.15]: 




(1) 



By uniqueness of (1), and with suitable changes of variables, we easily obtain: 



(where (7„ denotes the probability measure on the Euclidean sphere §" C R"). 
It is still valid for any two-step stratified group. 

2.3 Maximal L^- inequality 

Here, we recall the definition of the maximal function associated to an oper- 
ator over A^,., in particular of the spherical maximal function A, and of the 
standard maximal function A4; this is still valid for any stratified group. 

Let us start with the definitions of dilations for subsets, distributions 
and operators over Ny. Let r > 0. The r-dilation oi E (Z Ny is r.E — 
{r.n,n e E}, and if is a measurable set, we have \r.E\ — r'^\E\. The 
dilation Fr of a distribution F on A^^,, is given for a test function / on 
by < Fr, f >=< F,f{r.) > where f{r.) : n fir.n). The r-dilation % of 
an operator T on a dilation invariant space of function on is given for a 
function / by: T^.f = (T/(r.)) For a convolution operator with an 

integrable function or a measure, the r-dilated operator coincides with the 
convolution operator with the corresponding r-dilated function or measure. 

Let T be an operator on a dilation invariant space of function on A^^. We 
define the maximal function associated to T: T : / i— > supj.>o \Tr-f\- We say 
that T satisfies an -inequality (or T satisfies an maximal inequality, or 
T is I^-bounded) if there exists a constant C — C{T,v,p) > such that for 
all smooth compactly supported functions / on A^^ (or equivalently the class 
LPiNy), the Schwartz class S{K,) . . . ), we have: ||T./||^, < C ||/||^,. 

The maximal spherical function A is the maximal function associated to 
the convolution operator with the measure /i (see (1)). The aim of this paper 
is to establish i/-inequalities for A. 

Let A4 denote the standard maximal function, i.e. the maximal function 
associated to the characteristic function of the unit homogeneous ball Bi :— 




[ /(n)d/i(n) = 2 / / / fie^ptX + ^/{T^Z) 



da,{Z)day{X)t''-\l - 1^)^ dt 



(2) 
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{n e iVy; |n| < 1}. During the proof of our main result, we will use the 
well known L^-inequalities (1 < p < oo ), satisfied by the standard maximal 
function A4 [2]. We will also need the following corollary: 

Corollary 2 Let m : R"^ — > be a decreasing function and F : N ^ 1R+ be 

defined by F{n) — m{\n\), n E N^. Suppose F e . The maximal function 
associated to the convolution operator with F satisfies LP -inequalities, for 
1 < p < oo. 

2.4 Square functions 

For j = 1, 2, . . ., we define the following operator, called the square function 
S^, by: 

S\f){n) := ^ j^mf * l^s){n)\^s^^-^ds , f e S{N,) , neN, ■ 

We will have to show that for some j, the square functions satisfy L^- 
estimates: 

i.e 3C^C{v,j)>0 V/e5(7V,) \\S^ .f\\^, < C \\f\\^, . 

In Section 5, using the Plancherel formula and spherical functions, we will 
obtain: 

Theorem 3 We assume v > 4. The square functions , j = l,...,h, 
satisfy L"^ -estimates, where h eN, 1 < h < {z — 2)/2. 

3 Proof of L^-maximal estimates for A 

Here we will prove that the L^-boundedness of some square functions 
implies the i/-boundedness of A, for some p. We summarize this fact in the 
following Theorem: 

Theorem 4 If the square functions satisfy L"^ -estimates, then the spher- 
ical maximal function A satisfies LP -estimates, where: 

a) j — 1 and 2<p<oo if v > 2, 
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b) Kj <h<{Q- 2)/2 and 2h/{2h - 1) < p < oo if v > 2. 



This proof extends naturally to any stratified Lie groups. Furthermore The- 
orems 3 and 4 imply Theorem 1. In this section, we denote Ny — N. 

3.1 Proof of the L^-case, p>2 

Here we prove Theorem 4. a): we assume that the square function is L^- 
bounded and we prove the i/-boundedness of p > 2. 

We follow the Euclidean process [15, XI§1]. For / e S{N), we have: 

1 /"* 

f^t*f{n) ^ J dsis^Hs* f{ri))ds 

= ^ j^QsQ-'l^,*f{n)ds + ^ J\'^ds{i^,*f{n))ds .(3) 

We compute = \B{n,t)\/\Bi\, where B{n,r) = {n/ G A^, |nn'^^| < r} is 
the homogeneous ball with radius r, centered at n, and with change in polar 
coordinates (1): 

^ fQs'^-'l,s*f{n)ds = Qrj^^ [ f{n")dn" . 
Jo \B{n,t)\ jB{n,t) 

Because of Holder's inequality, the last expression in (3), is majorized by 
{2Q)~^^^S\f{n). Finally, we gather: 

\B[n,t)\ JB(n,t) y2Q 
Taking the supremum over t, we have the following pointwise estimate: 

V/e5(iV) A.f <QmM.f + -^S\f . (4) 



The standard maximal function M. satisfies i/-inequalities , in particular for 
p = 2 [2]. As the square function is assumed to be L^-controlled, the 
inequality (4) leads to an L^-inequality for A. But A satisfies also an L°°- 
inequality (because the measure ^ is finite). By classical real interpolation, 
we obtain the iT'-boundedness of ^, for p > 2. Theorem 4. a) is thus proved. 
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3.2 Overview of the proof of the iZ-cases, p < 2 

Here we prove Theorem 4.b). We start with a choice of an analytic fam- 
ily of operators A"", the same as in the Euclidean case [14, 16], see (i) of 
Subsection 1.1. A° coincides with the convolution operator with kernel /i. 
Provided that the square functions .S'-', 1 < j < h, satisfy L^-estimates, we 
prove that A" satisfies i7-maximal inequalities, for > 1 with 1 < p < oo 
(Subsection 3.4), and for 3?q; > —h + 1 with p — 2 (Subsection 3.5). To 
obtain these maximal inequalities, we will use Corollary 2, and the following 
estimate "uniformly in y G R, locally in x > 0" for the F function [20, page 
151]: 

V[a, b] C [0, oo[ 3C> Vx e [a, b] Vy e R 

C-'<'-^fSS^<C. (5) 

From these maximal inequalities, with interpolation (Subsection 3.6), we will 
deduce Theorem 4.b). 

3.3 Analytic family of operators 

Let define (as in the Euclidean case, see [14] or Subsection 1.1) for a e 
C\(-N): 

_ 2(1 -IrP)"-' 
r{a) 

and 

//°^(n) = m°(|n|) , neN . 

For 3?q; > 0, the function /f is radial and integrable; we denote by A"' 
the convolution operator with kernel /i"'; it is a L^-bounded operator for 
1 < p < oo. 

Let j.h E N such that < j < h and 1 < h > Q/2; we define also the 
operator for / G S{N), and n E N, by: 

Bl.{f){n)= [ m"+'Xr)r^-'-"'+^5^(/*/i.)(^)rfr . 

Jr=0 

Proposition 5 The family of operators {A", 3?q; > 0} is analytic, and ad- 
mits an analytic continuation over {^a > 1 — (Q — 2)/2} as operators on 
S{N). The operator A^ coincides with the convolution operator with kernel /i. 
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For 3?q; > 1 —h with h < {Q — 2)/2, can be written as linear combination 
of the operators B^j, < j < h. 

Proof of Proposition 5: With the change in polar coordinates (1): 



A'^.f = f ^Al - rr-\f * Pir)r^-'dr 
Jr=o r(Q;) 



aT(a) — 2r 



r=0 



after integrating by parts. The endpoint terms equal zero, and ar{a) = 
r{a + 1); we easily obtain on one hand for a — 0: A^.f = / * /x, and on the 
other hand after expanding the derivative: A°' — — l/2(Si^i + QBi^). 

Recursively, using h integrations by parts, we easily compute that the 
operator A"' coincides with a linear combination of the operators B^j, pro- 
vided that the endpoint terms equal zero, so as long as h < {Q — 2)/2 and 
Ua>l-h. □ 

Now we establish some L-^-maximal inequalities on A". We denote by A"" 
the maximal function associated to A" (see Subsection 2.3). 

3.4 L^-maximal inequalities for > 1 

In this subsection, using Corollary 2 and estimation (5), we prove: 

Proposition 6 For 1 < p < oo, we have: 

Vfo > 1 Vx e [1, b] 3O0 yyeR V/ e S{N), 
\\A^+^y.f\\^,<Ce'\y\ 11/11^, . 



Proof of Proposition 6: For a; > 0, and / € S{N), we have: 

\A^+^y.f\ < l/l * l^^+^^l = 1 ,^^5 J |/|*/x" < Ce^l^l A^l/I . 

L[x + ly) 

uniformly in |/ G M, locally for x > 0, because of (5). It yields to A^^'^'^.f < 
Ce^^y^A^.\f\. Now, For x > 1, fi^ satisfies the hypothesis of Corollary 2, and 
the maximal function A^ is Z/'-bounded, 1 < p < oo. □ 
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3.5 L^-maximal inequalities for < 

In this subsection, we fix h = 1,2, . . . and we prove: 

Proposition 7 If the square functions , j = 1, . . . , h satisfy L'^ -estimates, 
then for all segments [a, b] c] — /i+ 1, oo[, there exists a constant C > such 
that: 

Vx e [a,b] Vy G M V/ e S{N), \\A^^''.f\\^, < Ce^l^' ||/||^. . 

This proposition is implied by the following lemma, which states estimates 
for the maximal function B'^j associated (see Subsection 2.3) to B^^: 

Lemma 8 For all segments [a,b] c] — h + l, oc[, there exists a constant 
C > such that for all x e [a, 6] and for all y G M, we have: 

yfeL^ ||B,T-/IL^ < Ce'\y\\\f\\,. , (6) 
\/feS(N) < Ce'l^lj^^'./I . (7) 

The proof of Lemma 8 is based on Corollary 2, known formulae for T and 
estimation (5). 

Proof of lemma 8: Because of the change in polar coordinates (1), we 
compute that B^q is the convolution operator with kernel given by: n ^ 
^a+ft,^^^|^|-2/i^ n e A^. Then we proceed as in the proof of Proposition 6 to 
obtain inequality (6). 

Let us prove inequality (7). For / e S{N), we have: 

{By^.f = f m-+\r)r'^-'-"^+Hndi.,f*i^r']\r'=rtdr . 

Jr=0 

Thus because of Holder's inequality, (B'^j.f)'^ is majorized by the product of 

pi poo 

sup / y-y[di,f*fXr']\r'=rt\''dr < / j^',/ * A^,, | V'^-'dr' 

t>0 Jr=0 Jr'=Q 

= {s'if))' , 

(with the help of change of variable r' — rt) and the integral: 



/' 

Jr=0 



^' ' - Jr=o |r(a + /i)P 
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This last integral equals with the change of variable r' = r'^, then with known 
formulae concerning the F function [17, §1.7 (4) and (5)]: 



.1 (1 _ ^'f.+h-i) ^ i r{2x + 2h-l)riQ-2h) 

X,=o |r(a + /i)|2 2 2 \r{a + h)\^r{2x + Q) 

Because of estimation (5), this term is bounded up to a constant, locally in 
X > —h + 1, uniformly in |/ G M, by e^'^L We obtain inequality (7). □ 

This ends the proofs of Lemma 8 thus of Proposition 7. 
3.6 Interpolation 

The maximal function A — 2^° (Proposition 5) satisfies an L°°-inequality 
because the measure is finite. We have proved in Propositions 7 and 6, 
that the family A"' satisfies L^-maximal inequalities. Using linearisation and 
interpolation of an analytic family, we obtain that the maximal function A^ 
satisfies i/-inequalities for {2h)/{2h — 1) < p < oo as long as the square 
functions , 1 < j < h satisfy L^-estimates and 1 < /i < (Q — 2)/2 (so 
V > 3). 

We have proved Theorem 4.b). This achieves the proof of Theorem 4, 
and thus of our main theorem, provided that we show Theorem 3. The last 
section (Section 5) is devoted to this, but we start (Section 4) by recalling 
our tools: the Plancherel formula and bounded spherical functions. 

4 The Bounded Spherical Functions and the 
Plancherel Formula 

Here we present the tools that we will need in the proof of Theorem 3: the 
Plancherel formula and bounded spherical functions on Ny. For this results, 
we refer the interested reader to [5]. 

4.1 Action of 0{v) 

With the canonical basis, the vector space Z can be identified with the vector 
space of skew-symmetric v x v-matrices M^^. 
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The group 0{v) acts on Vy ~ W and ~ M^^ by auto-morphisms : 



We get easily k.[X,X'] = [k.X,k.X'], k e 0{v), X,X' e V^. So, 0{v) acts 
(by auto-morphisms) on the Lie algebra A/'t, , then on the group Ny. 

A distribution or a left invariant differential operator on Ny is said to be 
radial, if it is ©(t)) -invariant. 

4.2 Special functions 

First, let set the notations for "our" Hermite, Laguerre and Bessel functions. 
We denote: 

• hi,l the Hermite- Weber functions on R given by [17, §5.5]: 



• Cn, the Laguerre function given by Cn{x) = L^^i^)^ ^ where L° is the 
Laguerre polynomial of type and degree n [17, §5.1], 

• J'a the reduced Bessel function: J'a{z) := T{a + l){z/2) "Ja{z), where 
Ja is the Bessel function of type a > [17, §1.71], [4, ch. II, I.l]. 

Now, we can give some spherical (or equivalently of positive type) func- 
tions of {Ny,0{v)). We denote: 

• dk the Haar probability measure of 0{v), 

• for A = (Ai, . . . , A^,') e M.'"' , D2{A) an element of Z* identified with the 
skew-symmetric matrix: 




and 




hi{x) = {2H\^) ^e-'^Hiix) where Hi{s) = (-l)'e*'(ci/cis)^e- 



AiJ 



D2{A) : 











where J : 



1 
-1 



(0) 



((0) means that a zero appears only in the case t; = 2t;' -|- 1.) 



• X^, ...,X* the dual base of Xi, ...,X, 
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• pr^- the orthogonal projection on M.X2j-i ® lRX2j, for j = 1, . . . , v', 

• C the set of A = (Ai, . . . , \y>) G W' such that Ai > . . . > A^/ > 0, 

• M the set of (r, A) with A e £ and r > if v = 2v' + 1 or r = if 

V = 2v', 

• V the set of (r, A, I) with (r, A) e X and Z e N^'. 
For (r, A, Z) e V, we define the function 0'"'^'' by: 

where G''"'^'^ is given by: 



Jo{v) 



e^'^''(exp(X + A)) = e^<'-^-^>e^<-°^(^)'^> fl /:r(^|pr,(X)|2) . 

j=i ^ 2 

The function ({f'^'^ is a spherical function of {N^,,0{v)). In the rest of this 
article, we identify a function 0'''^'', with its parameter (r, A, /) e V. 

4.3 The Plancherel Formula 

Let (r, A) e A4. Let define the representation {L'^{R'"'),Ilr,A) e Ny by: 

where / G L2(R'''), G W\ n = exp(X + >1) G A^^ with X = 

The group O(t') acts on iV^ thus also on A'^. In particular, we denote: 

k.Ur,A{n) = Ur,Aik^^-n) , k G 0{v), n e . 
We denote 77 the measure on C given by: 



dri{A) 



n Ai n (A2 - XlfdXi . . . dXy, if V = 2v', 

=1 i<fc 

n Af n (A2 - A2)^dAi . . . dXy, if V = 2v' + 1, 
13 



1=1 ' j<k' ^ 



and by r the Lebesgue measure on R*"*" iiv = 2v' + 1, and the Dirac measure 
in if u = 2v' . Let m be the measure on A4 x 0{v) given as the tensor 
product of r, rj and dk, up to a normalizing constant so that we have the 
Plancherel formula: 

Theorem 9 m is the Plancherel measure of N^: 

V/e5(Ar,) 11/11^, = I ||/c.n,,A(/) 115,^ (im(r, A, /c) , 

where \\-\\hs denotes the norm of an Hilbert- Schmidt operator. 

For I = ih,...,l,,) eW\ let e L^W') be given by: CiiVi, ■ ■ ■ ^Vv) = 
U]^^hi.{yj). The vectors Q, I e W , form an orthonormal basis of L'^{W') . 
If / is radial, the Hilbert-Schmidt norm of n(/), can be computed with this 
basis, in term of spherical functions: 

Proposition 10 Let f be a radial integrable function (or a radial finite mea- 
sure) on N^. We have: 



5 Square functions 

This section is devoted to the proof of Theorem 3. Actually, we will prove 
(Subsection 5.1) that the L^-norm of square functions , j = 1,2,..., is 
bounded by the L°°-norm of : 



S^{<P) := \di <iisA> Ts^J-ids ,(t>eV : 

In this section, ||.|| denotes the L^(A^t,)-norm. 

Proposition 11 We have for f e S{Ny) and j >1: 

\\S^{f)\\< sup S^{ct>) 11/11 . 
(per 

Next (Subsection 5.2), we obtain the following boundedness for S^: 
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Proposition 12 Let h be an integer such that 1 < h < {z — 2)/2 (only for 
V >4:). We have: 

3O0 y(f)eV S''{(f)) < c . 

For the last proposition, we will use technical lemmas, which will be proved 
in Subsection 5.3. 

Propositions 11 and 12 imply Theorem 3. 

5.1 and 

Here, we prove Proposition 11. Let / e S[Ny). With the Plancherel formula 
of Section 4, we will prove in this subsection that we have: 

P'{f)\^ = /^^ |^^(0'-'^'')r|A;.n,,A(/).Orcim(r,A;,A) . (8) 

Because of the Plancherel formula (see Theorem 9), this equality implies: 
\\S\f)f < sup 1^^(0)1^ / J2 \k.Ilr,A{f)-Ci\'dm{r,k,A) 

= sup|^^(0)ni/||^ . 

Thus Proposition 11 is proved, if equality (8) is satisfied. 

Let establish equality (8). Fubini's equality and the Plancherel formula 
(Theorem 9) for a^ (/ * e S{N) yield to: 

\\SKf)f= J2\^-^r,Amf*f^s)).Ci\'drn{r,A,k)s'^-'ds . (9) 

Because /ig is a radial probability measure, k.Ilr,A{fj,s) equals nj.,A(A*s)5 and 
we have (Proposition 10): ^r,Aif^s)-Ci —< A*s)0'^'^'' > Ci- Then we deduce: 

k.Ur,A{f)k.IlrAl^s).Cl = </Xs,(/)^'^''> A;.n,,A(/).0 

k.Ur,Aidlif*f^s))-Cl = a^</i„0^'^''>fc.n,,A(/).O . 

This last equality, with (9) and Fubini's equality, yield to: 

ii'^'(/)ir= / E r \di.< ^is,f \'s'^-'ds\k.ur,M-ci\' 

dm{r, A, k) . 
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Because of definition oi , we deduce equality (8). Thus Proposition 11 is 
proved. 



5.2 Boundedness of 

Here, we prove Proposition 12. The tools are some computations and prop- 
erties of special functions (which are recalled in Subsection 4.2). We remark: 

Lemma 13 Let f be a smooth function on R. For h — 1,2, . . ., the derivative 
g^^\s) of g{s) — /(s^) is a linear combination of s'^^'^^ f^'^ '^^\s'^) , where: 

ifh = 2h', d{j, h) = 2j, onO<j< h' , 
ifh = 2h' - I, d{j, h) = 2j + 1, onO<j<h'-l. 

We remark d{j, h) + h — 2h' + 2j. 

We use also lemmas, (whose main lines of proof are given in the following 
subsection), and the following notations: we fix = 0^'^'' e V and h — 
1,2,.. .; we set for n,h&N: 



UCi.{Xjs'r 



2 



j=i ' 2 
We denote for g ^ {hi, h2) G N^, j = (ji, J2) e N^: 

J9,J I \ff'^s)\^s^^-'ds , 



da,{X) 



b9'j(s) := s^'^'"' / 6'''^'i+^'i(t,s) J-£|+''\s'v^r^|A|) 

Jr=0 2 

(Vl^\A\f'^'' t^-\l-t^)'^dt , 

where h = h — hi — h2 and for i = 1, 2: di := d{ji, hi). If v is odd, we denote 
h — hi + /i2- 

Lemma 14 < fis,<P > is a linear combination of ¥'^{s) over g,j such 
that hi + h2 + h = h, where h = if v is even, and < ji < hi/2, i = 1,2. 

Proposition 12 will be implied by: 
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Proposition 15 The integrals P'^ are bounded independently of (A, r, /) e 
V, for all parameters g,j given in Lemma 14, as long as 1 < h < {z — 2)/2 
(ifv>A). 

The rest of this subsection is devoted to its proof, first liv — 2v' and 
/i 7^ 0, or if V = 2v\ then if v = 2v' + 1 and h = 

We will use the following property of the Bessel functions, deduced from 
the analyticity of the Bessel function Ja, its boundedness on M, and the 
classical majorations for Jq.: 

/■oo 

V-l</3<2Q;VneN : / \ji''\s)\^ ds < oo . (10) 

Js=0 

5.2.1 Boundedness of J('»i.'»2),(ji,j2) \ih^Qovv = 2v' 

Here, we assume {h ^ Q/u = 2v' or {v = 2v') and we show Proposition 15 
for these cases as long as /i < (2; — 2)/2. We will use majorations of b'^'"'{t, s), 
given in the following lemma which will be proved in next subsection. 

Lemma 16 The expressions b^'"'{t,s), for < n < h, are bounded up to 
a constant ofv,h by: (|^|^^)"'S~'* ^q^^^^ if v = 2v' , we assume 

Using this lemma and Cauchy-Schwarz inequality, we obtain that \b^'^{s)\^ 
is then bounded up to a constant by: 

1 

Jo 

\jh''''\s^VT^\A\){l-t^)—^—^-'\^dt . 

2 

Finally, I^'-' is bounded up to a constant of v, h by the maximum over < 
i < h of: 

poo 

._ |^|2(^+j2+hi+ji+i) / g2(di+(i2)-2/i+4j 

Jo 

[' \j!i^''\s'Vl^\A\){l-t')"^^^'-'^\'dt s'^-^ds . 

Jo 2 
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We compute another expression of the exponent of s (see Lemma 13) and 
the change of variable s' — s^Vl — 

Js'=o ^ 2 



I 

Jo 



Because of (10), we deduce that J^'\i = 0, . . . ,h, < ji < h[, < j2 < h'^, 
are finite as long as h'l + h'2 ^ and h < {z — 2)/2. Proposition 15 is thus 
proved if (/^ ^ 0, t; = 2v' + 1) or {v = 2v'). 

5.2.2 Boundedness of ii v ^ 2v' + 1 and h = h, 

In this sub-subsection, we will assume v = 2v' + 1 and h = h < {z — l)/2, so 
r 7^ and g = j = (0, 0) = 0; we show Proposition 15 for this case. 
We will use the following majoration of |6^'°(r, s)|: 

Lemma 17 If v — 2v' + 1, b^'^{t, s) is bounded up to a constant by: 

0<i<h 

Because of the previous majoration of b^'^{r,s) of Lemma 17, |6°'°(s)p is 
bounded up to a constant by the maximum over i — 0, . . . ,h of: 

I / s-WAlsHyu^is^VT^lADlf'-'ii - t*)'^dt] 
</ \s~WA\sHy\j^{s^Vi^\A\)\{i-t^)~\^dt ir-^i^dt , 

Jo ^ Jo 

by Holder's inequality. Thus by Fubini's equality, /°'° is bounded up to a 
constant by: 

1 roo J 

{\A\sH''f\J^{s^Vl^\A\)\^-{l - ty-^dt 
2 s 




^0 



= j^°°.'^v^(«or^/ t''{i-tr-'-'dt , 
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with Fubini's equality after the change of variable s' — — t^\A\. Thus 

by Fubini's equality, is finite as long as z — 2 — h > —1 (because of the dt- 
integral) and 2h—l < z — 2 (because of the rfs-integral and majoration (10)). 

As the other cases where proved in the previous sub-subsection, Proposi- 
tion 15 is also proved as long as Lemmas 14, 16, 17, are shown. 

5.3 Proof of the technical lemmas 

In this subsection, we give the main lines of the proofs for lemmas used in 
the previous subsection. 

5.3.1 Proof of Lemma 14 

To prove Lemma 14, we need the following property of the Bessel functions: 

/ e'<''y>dan{y) = Jn^{\x\) , (11) 

where <, > denotes the Euclidean scalar product of R", and |.| its norms. 

Let = (p^'^^'' G V. First, we will need the expression of < fis,(p >■ As 
the probability measure /x^ is radial, and with the expression of given in 
Subsection 4.2, we have: 

<lis,(f>> - < i^s,Q"'^'^ >= [ e'''^''(s.n)(i/x(n) 

^ 2 [ [ [ e'''^\stX, sV(l - t^)A)da,{A)da^{X) 
Jo Js^ Js'^ 

r-\l-t^)'^dt , 

because of the expression (2) of /i. We notice: 

/ e^^^'\hX,hA)daM) = e^*^''"".n>C/,(^|pr,-(tiX)|2) 

/ e^'-^<^'^>daM) ; 

The last integral against equals .7^-2 (t9|A|). because of (11). We then 
obtain: 

Jo ^ 

J._^{s'^^^^^\A\)f-\\-t''\^dt . 
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We can now show Lemma 14. The expression 



Qh 



j=l 



2+2 \ 3^ 



)J^{s''^/l^^\A\) 



is a linear combination over h + h — h and hi + h2 — h of: 



2+2 



wAX)\ 



2 n 



J^{s'\fl^\A\) 



Computing each derivative (using Lemma 13 for the second and the third 
one), Lemma 14 is proved. 



5.3.2 Proof of Lemma 16 if v = 2v' 



To prove Lemmas 16 and 17, we will use the following remark, deduced from 
the properties of Laguerre functions [18, Lemma 1.5.3]: 

Lemma 18 The functions Ck and its derivatives are hounded on M+, inde- 
pendently of k (but not of the derivation order). 

We assume here v = 2v'. From Lemma 18, we deduce that 

|pr,(X)p 



'„2 I 



IlCi.{Xjs'r 
j=i •'^ 



-) 



is majorized up to a constant oin,v by the sum of 



urn (t^ 



(t^ir.nr 



|pr,(X)|Y ^' 



where the sum runs over the subsets J of M fl [1, v'], and Cj e N, j e J, such 
that ^jgj = n. We thus obtain that s) is bounded up to a constant 

of n,v by (i^|74|)". Lemma 16 is then proved for v — 2v'. 



5.3.3 Proof of Lemma 16 if 7^ and of Lemma 17 

We assume here v = 2v' + 1 and /i 7^ 0. In this case, proof of Lemma 16 is 
based on suitable h integrations by parts. We only prove the case {h, n) = 
(1,0). The general case is similar. 



20 



Let choose as atlas of the Euclidean sphere S'' of My two caps with poles 
Xi and —Xi. 

Ci :^ {X e S\ < X,Xi > > -U , 



and 



C2 := {XeS\ <X,-Xi>> -} . 



Then we fix a partition of unity, i.e. two smooth functions ipi, ip2 on §" such 
that: 

supp ipi C Ci and 0<'^i<l, i = 1,2 , and ipi + ■ip2 = 1 on . 

As chart over Ci (respectively C2), we consider the stereo-graphic projection 
with pole Xi (respectively —Xi), and we denote C[ (respectively C2) its range 
over My~^. C[ et C2 are compact subsets of M^~^. The points X = '^■XiXi 
of the sphere are parameterized by the coordinates Xi,i 7^ 1; furthermore, 
the measure is mapped over Ci,i — 1,2 a measure with a smooth density 
Di, i = 1,2 over the Lebesgue measure dx. 

We decompose the integral 6^'°(i,s) on this atlas and we integrate by 
parts. We obtain: 



E 

i=l,2 



/ S 



\vv-(X)\^ 



dx 



=1,2 



\vv(XW 
J — -1- ^ 



da; 



(X is parameterized by x on each Q.) From Lemma 18, and the properties 
of the chosen atlas, and with l^l ~ ^j^^jo^ obtain the majoration of 
Lemma 16 for {h,n) = (1,0). The rest of the proofs of Lemmas 16 and 17 
are similar. 
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